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Abstract of EP0476920 

An onboard Instructor station for a training device provides a 
human/computer interface that is designed to support an 
optimum instructor's scan pattem of the training scenario. All 
displays and switches required to control and monitor the 
mission are resident at the instructor's work surface directly In 
front of, and tangent to the instructor's seated position. This 
design allows for a dedicated over-the-shoulder observation 
position. Therefore, the instructor may simultaneously observe 
trainees' actions, a visual scene and device instrumentation 
while controlling and monitoring the training environment 
through embedded situational awareness displays and 
con-esponding switches at the work surface. The unique 
aspect of this design is the one position from which all tasks 
can be accomplished through the support provided by the 
packaging. This packaging employs flat panel displays which 
replace the traditional, larger CRT units. 
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@ Training device onboard Instruction station. 

@ An onboard instructor station for a training device provides a human/computer interface that is 
designed to support an optimum instructor's scan pattern of the training scenario. All displays and 
switches required to control and monitor the mission are resident at the instmctor's work surface 
directly in front of, and tangent to the instmctor's seated position. This design allows for a dedicated 
over-the-shoulder observation position. Therefore, the instmctor may simultaneously observe trainees' 
actions, a visual scene and device instnjmentation while controlling and monitoring the training 
environment through embedded situational awareness displays and corresponding switches at the 
woric surface. The unique aspect of this design is the one position from which all tasks can be 
accomplished through the support provided by the packaging. This packaging employs flat panel 
displays which replace the traditional, larger CRT units. 
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BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention generally relates to conv 5 
puter-aided training devices of the type commonly 
referred to as simulators and, more particularly, to the 
type of training devices which include an onboard 
instructor's console. Training devices of this type 
include simulators for vehicles such as transport air- io 
craft, ships and large land vehicles and simulators for 
fixed station facilities such as power generators and 
chemical processes. 

Description of the Prior Art is 

Training devices or simulators present scenes to 
a trainee to allow the trainee to practice some task, 
such as flying an airplane. In a flight simulator, for 
example, a three-dimensional model of the desired 20 
"gaming area" is prepared and stored on magnetic 
disk or similar bulk storage media. The visual 
simulator combines an image generator with an elec- 
tro-optical display system such as a cathode ray tube 
(CRT) or similar display. The image generator reads 25 
in blocks of three-dimensional data from the disk and 
transfonms this data into two-dimensional scene des- 
criptions. The two-dimensional data are converted to 
analog video that is presented to the trainee via the 
display. The generated imagery is meant to be rep- 30 
resentative of the true scenes that the trainee would 
see if the trainee were actually perfomning the task 
being simulated. The generation of the display images 
is said to be in "real time" which is normally taken to 
mean 30 frames per second, as in the U.S. television 35 
standard. Computer image generating (CIG) systems 
are described In detail in the book entitled Computer 
Image Generation edited by Bruce J. Schacter and 
published by Wiley-lnterscience (1983). 

There are basically two types ofsimulators used 40 
for training purposes; those having an instructor's 
console on the simulator floor and those where the 
instructor's console is onboard. An example of the for- 
mer type is a simulator for high performance aircraft, 
usually of the single-place variety. The present inven- 45 
tion is specifically directed to the tatter type of 
simulator where an instructor or senior crew member 
is on board the simulator with the trainees as part of 
the training mission. This would include any crew ser- 
ved vehicles but could indude other training environ- so 
ments such as power plants, refining plants and the 
like. 

The prior parallel configuration that supported 
instructor station facilities contained CRT displays 
with adjacent switch panels as part of the instructor's 55 
console. This type of display necessitated locating the 
instructor's console away from the trainees' positions. 
The arrangement was such that the instructor would 



have to sit at the instructor's console to control the 
training environment and then move to a position 
behind the trainees to observe the trainees' actions. 
In this latter position, the instructor could also observe 
the visual scene presented to the trainees, but when 
sitting at the instructor's console, the visual scene, 
including any instrumentation, was not readily obser- 
ved by the instructor. Therefore, it was necessary to 
replicate much of the training environment at the 
instructor's console. 

An example of the prior onboard instructor station 
is illustrated in Figure 1. This figure is a plan view of 
the interior of a'simulated aircraft cockpit and support- 
ing instructor station structure 10 for an aircraft 
sinnjlator. Entry to the simulator platform is by means 
of a door 11. This platfomn is provided with CIG dis- 
plays generally indicated at 12 which present a visual 
scene to the trainees through the cockpit windshield 
13. There are two trainee positions; one for the pilot 
at 14 and the other for the co-pilot at 1 6. Along the axis 
of the cockpit are a pair of tracks 1 7 and 1 8 on which 
are mounted an instructor's seat 20 and an observer's 
seat 22. The observer's seat is shown at the back of 
the cockpit in its stowed position. The instructor's seat 
is shown facing an instructor's console 23 which 
includes two CRT displays 24 and 25 and a work sur- 
face 26. In addition the to the instructor's console, 
there is schematically indicated an onboard I/O 
(input/output) rack 27 which provides the connections 
to simulator computer system (not shown) on the 
simulator floor. 

In use, a training session begins by the instructor 
entering commands at the Instructor's console 23 to 
invoke a desired training environment Once the 
inputs have been made at the instructor's console, the 
instructor can swivel seat 20 counter clockwise by 90*^ 
and move it forward on the tracks 17 and 18 so that 
the instructor is just behind the right shoulder of the 
co-pilot and the left shoulder of the pilot. In this posi- 
tion, the instructor can observe the actions of the pilot 
and co-pilot over their shoulders and also observe the 
visual environment, including both the imagery pro- 
duced by the CIG displays 12 and the instrumentation 
at both the pilot's and co-pilot's positions. However, 
when the instnictor needs to adjust or change the 
training environment, it is necessary to move the seat 
20 back on tracks 17 and 18 and to swivel it clockwise 
90** to again have access to the instructor's console 
23. In so doing, the instructor cannot easily observe 
tiie visual environment presented to the trainees, the 
cockpit instrumentation or the trainees' actions. This 
presents a problem in the continuity of tiie training 
session. 

SUMMARY OF THE INVENTION 

it is therefore an object of the present invention to 
provide a training device or simulator with a full time 
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over-the-shoulder instructional position from which no 
changes in the forward-facing posture of the Instructor 
are necessary to control and monitor the training mis- 
sion. 

It is another object of the invention to provide an 
instructor's position in an onboard instructor station 
which makes possible a unidirectional scan pattem by 
the instructor to observe trainees' actions, the simu- 
lated environment and the human/computer Interface 
for the instructor. 

It is a further object of the invention to provide an 
efTicient packaging of the instructor's controls and dis- 
play for an onboard instructor station of a training 
device allowing a single instructor position and elimi- 
nating displays and work surfece required for the prior 
instructor console. 

According to the invention, the onboard instructor 
station for a training device provides a 
human/computer interface that is designed to support 
an optimum instructor's scan pattern of the training 
scenario. All displays and switches required to control 
and monitor the mission are resident at the instruc- 
tor's work surface directly in front of, and tangent to 
the instructor's seated position. This design allows for 
a dedicated over-the-shoulder observation position. 
Therefore, the instructor may simultaneously observe 
trainees' actions, a visual scene and device instru- 
mentation while controlling and monitoring the train- 
ing environment through embedded situational 
awareness displays and corresponding switches at 
the work surface. The unique aspect of this design is 
the one position from which all tasks can be accom- 
plished through the support provided by the packag- 
ing. This packaging employs flat panel displays which 
replace the traditional, larger CRT units. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and 
advantages wfll be better understood from the follow- 
ing detailed description of a preferred embodiment of 
the invention with reference to the drawings, in which: 
Figure 1 is a plan view of the interior of a simu- 
lated aircraft cockpit and supporting instructor's 
station structure depicting a prior art onboard 
instructor's station; 

Figure 2 is a plan view of the interior of a simulator 
cockpit showing the onboard, forward looking 
instructor station according to the present Inven- 
tion; 

Figure 3 is a profile view of the Instructor station 
according to the invention; 
Figure 4 is a plan view of the instructor's flat panel 
display and control assembly; 
Figure 4A is a cross-sectional view of one of the 
flat panel displays shown In Figure 4; 
Figure 5 is a plan view of an attemative configu- 
ration of the instructor's flat panel display and 



control assembly; 

Figures 6A and 6B are perspective views of a por- 
tion of the Instructor station showing the move- 
ment of the flat panel display and control 

5 assembly; 

Figure 7 Is hierarchical tree of display pages 
depicted In one implementation of the invention; 
Figure 8 is the initial display page depicted at the 
top of the hierarchical free shown in Figure 7; 

10 Figure 9 is a page displayed as a result of a selec- 
tion made from the initial screen shown In Figure 
8; 

Figure 10 is a page displayed as a result of a 
selection made from the screen shown in Figure 

15 9; 

Figure 11 Is a display page showing the gaming 
area in the form of a map and own ship's position 
with confrds that may be exercised by the instruc- 
tor; and 

20 Figure 1 2 is a display page showing a windowing 
function when the MALF (malfunction) button is 
pressed during the display of the page shown in 
Figure 11. 

25 DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 

Referring now to the drawings, and more particu- 
lariy to Figures 2 and 3, there are shown respectively 

30 a plan view and a profile view of the onboard instructor 
station according to a preferred embodiment of the 
invention. Figure 2 shows the interior of a simulated 
aircraft cockpit and supporting instructor station struc- 
ture 30 for an aircraft simulator, entry to which is by 

35 means of a door 31 . The cockpit is provided with CIG 
displays (not shown) as before. There are two trainee 
positions; one for the pilot at 34 and the other for the 
CD-pilot at 36. Along the axis of the cockpit are a pair 
of fracks 37 and 38 on which is mounted the instructor 

40 station 40. As best seen in Figure 3, the instructor sta- 
tion 40 is an integral unit comprising the instructor's 
seat 41 , work surface 43 with embedded displays and 
switches, and the work surface support structure 45. 
An observer's seat 42 is provided on the left side of 

45 the fracks 37 and 38. The observer's seat is shown 
pulled away from the wall of the cockpit and swiveled 
counter clockwise approximately 45"* to provide a 
view of the training session. The instructor station 40 
is shown pulled forward on tracks 37 and 38. This is 

50 the normal positbn of the instructor station during a 
fraining session. The instmctor station 40 is moved 
backward on tracks 37 and 38 only to allow ingress 
and egress by the trainees to their respective seats. 
It will be observed that there is no separate instruc- 

55 tor's console. Moreover, it is not necessary for the 
instructor statton 40 to swivel since all functions per- 
formed by the instructor are in the forward facing posi- 
tion. The functions of the instructor's console are 
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replaced by the flat panel display assembly 43 which 
is a part of the instructor station 40. 

As best seen in Figure 3» the instructor station 
includes the seat 41 having foldable amn rests 44 and 
mounted on the tracks 37, 38, which are flush with the 5 
floor. The foldable arm rests 44 may be individually 
pivoted up or down according to the preference of the 
instructor. In addition, the armrest 44 (Figure 3) on the 
left side of the seat 40 can be rotated upwardly to 
further improve the access. io 

Attached to the seat 40 is a support structure 45 
to which the flat panel display assembly 43 is 
attached. This attachment is hinged to provide a rota> 
tion of 90° from the horizontal position to a vertical up 
and locked position for Instructor ingress and egress. is 
The instructor station is shown in phantom outline in 
its stowed position 46 illustrating the fore and aft 
movement of the instructor station along tracks 37, 
38, as indicated by the double headed arrow 47. 

Figure 4 shows the flat panel display assembly 43 20 
as comprising two panels 48 and 49. In the embodi- 
ment shown in Figure 4, a damper 51 is provided to 
prevent the display assembly from rapidly rotating 
from the vertical to the horizontal position with such 
force that might damage the display assembly. The 25 
display assembly 43 is attached to the support struc- 
ture 45 by means of a hinge to permit the display 
assembly 43 to rotate about centertine 52 to a SO"" ver< 
tical position. A lock (not shown) holds the display 
assembly in the vertical position. 30 

With the flat panel assembly 43 in the position 
shown In Figure 4, it presents a work surface having 
embedded therein two displays 53 and 54, each with 
a bezel containing twenty push button switches 55 
and 56. In addition, there is provided a slew button 50 35 
in the support structure 45. The slew button operates 
like a track ball or joy stick, allowing the instructor to 
move a display indicator (e.g., a cursor) to select dif- 
ferent values depicted on a display page. For 
example, when values of such variables as latitude, 40 
longitude, altitude, heading and airspeed are dis- 
played, the instructor can use the slew button 50 to 
move the display indicator to a desired value and then 
select that value by depressing the slew button. 

In a preferred embodiment, the two displays 53 45 
and 54 are implemented using gas plasma displays 
approximately eight inches square. The panels them- 
selves are approximately twelve Inches square, pro- 
viding a combined surface of approximately twelve by 
twenty-four inches. Figure 4A shows a cross-sec- so 
tional view of flat panel assembly 43. The plasma dis- 
play 58 is housed within a case 59 having a thickness 
of approximately three Inches. An optical filter 60 is 
provided over the plasma display 58 to suppress 
glare, and over the filter 60 is a clear plastic 61. The 55 
clear plastic not only protects the plasma display 58, 
it also provides the instructor with a writing surface. 
Thus, it will be appreciated from Figure 4 that the top 



surface of the flat panel display assembly 43 provides 
the instructor all the functions of two displays, control 
switches and a work surface formerly provided by the 
console 23 shown in Figure 1. 

While the preferred embodiment of a specific 
implementafion uses two gas plasma displays and 
embedded switches, other displays and switch func- 
tions may be preferred depending on the application. 
For example, a single display 62, as shown in Figure 
5, may be substituted,for the two displays 53 and 54 
shown in Figure 4. The display or displays may be 
implemented with other flat panel display 
technologies including, but not limited to, liquid crystal 
display (LCD) technology. In fact, a color LCD type of 
display could have significant advantages where 
color can be employed as representing Information to 
the instructor. 

Also, supplementing the embedded push button 
switches In the bezel surrounding the display screen, 
a touch screen can be used and the switch functions 
can be depicted on a display page. A suitable technol- 
ogy for the touch screen is surface acoustic wave. 
This type of touch screen will respond only to a finger 
touching the display screen and not to larger objects, 
such as a note pad, so that the work surface can be 
used as a writing surface without unintentionally 
inputting commands and selections. 

Whatever the implementation, the display assenv 
bly 43 is compact and easily moved from a horizontal 
to a vertical position as illustrated in Figures 6A and 
6B, respectively. In addition to being compact, the dis- 
play assembly 43 provides a highly flexible 
human/computer interface for the Instructor. The push 
button bezel mounted switches, when actuated, pro- 
vide the instructor with a tactile feedback to confinm 
that the appropriate switch action has been conv 
pleted. Human engineering principles support this 
mechanism wherein the instructor's primary scan 
remains forward on the trainees' actions without 
diverting attention to confirm switch actuation at the 
instructor's woric surface. 

In the embodiment shown in Figure 4, functions 
of switches 55 and 56 are programmable to be display 
dependent with display pages depicted on displays 53 
and 54. By way of example, Figure 7 shows a specific 
display page hierarchy of an instructor station 
implemented in a flight simulator. At the top of the 
hierarchy, the instructor may select a gamlng'area, 
coastal lowlands or desert, and maintenance utilities. 
Assuming that a gaming area is selected, the instruc- 
tor can select various training procedures, one of 
which is "checkride". Selecting the checkride option 
provides the instructor with several other options 
which control the training environment 

The manner in which the instructor accesses the 
various functions and Inputs commands during the 
training session is illustrated in the following figures. 
Referring first to Figure 8, there is shown the initial dis- 
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play page 70 corresponding to 'the top of the hierarchy 
shown in Figure 7. This is the gaming areaAjtility dis- 
play page. The marks 71 about the periphery of the 
display page indicate the positions of the push button 
switches embedded in the bezel surrounding the dis- 5 
play. The title of the display page is displayed at 72, 
and in the upper hght hand corner, the mission time 
is displayed at 73. Along the left hand edge of the dis- 
play page, there is but one function displayed and that 
is "maintenance". Along the right hand edge of the io 
screen, two functions are displayed, and they are 
"coastal lowlands" and "desert". Only the push button 
switches for which a function is displayed are oper- 
ational for this particular screen. Along the top edge 
of the screen, three commands, "motion", "tutor" and is 
"freeze" are displayed. No selections are provided for 
the push button switches at the bottom edge of the 
screen. 

Should the instructor select the coastal lowlands 
option, the display page shown in Figure 9 is next pre- 20 
sented to the instructor. Notice that the title of the 
screen at 72 changes to reflect the name of the screen 
currently being displayed and that the mission time 
continues to be displayed at 73. In the display page 
shown in Figure 9, various functions are displayed 25 
along the right edge of the display, and these are dif- 
ferent from those of the previous display page. There- 
fore, the functions of the push button switches have 
changed. In addition, there is now an additional conrv 
mand, "menu", displayed at the top edge of the dis- 30 
play. Selecting this command returns the display 
page at the top of the hierarchy shown in Figure 8. 

If the instructor selects the "checkride select" 
function by pressing the corresponding push button 
switch adjacent the display in Figure 9, the screen 35 
shown in Figure 1 0 is next displayed. Thus, it is poss- 
ible for the instructor to navigate through a hierarchy 
of screens as generally indicated in Figure 7. 

The screens shown in Figures 8, 9 and 10 illus- 
trate a succession of display pages which may be dis- 40 
played on one of the display screens 53 and 54. 
Situational display pages are provided on the other of 
these two panels allowing the instructor full control 
over the training session. An example of a situational 
display is shown In Figure 1 1 where ownship position 45 
81 is shown on a map relative to navigational points 
82, 83 and 84, such as TACAN stations. At the bottom 
of this display page are commands "mark", "nnair (for 
malfunction) and "print". The an-ows adjacent the 
"print" command indicate which of the two display so 
pages are to be printed. 

If the "MALF" command push button switch is 
pressed, the windowed display page shown in Figure 
12 is presented to the instructor. The windows depict 
the activated circuit breakers and malfunctions that ss 
are active in the simulation. 

Within the training device industry, the present 
invention provides a human/computer interface that 



supports the concept of over-the-shoulder instruction 
for the entire aew from an integrated instructor sta- 
tion. Training devices that require onboard instructor 
positions are all potential candidates for the invention. 
The applicatbns span both military and civilian appli- 
cations. The invention applies to all crew served vehi-. 
cles, such as aircraft and ships, where an instructor's 
presence is required. The instructor station is an inte- 
gral unit supported by a remotely located industry 
standard graphics workstation; therefore, the inven- 
tion can be implemented as a stand alone workstation 
in a training environment where the instructor's or 
senior crew member's skills are necessary to the 
training mission. 

As mentioned the display can be implemented in 
any of several flat panel display technologies. The 
human/computer interface can be further augmented 
by the software supporting the Instructor station. For 
example, instead of using programmable switches, 
extensive use can be made of "point-and-shoot" 
software interfaces using a pointing cursor controlled 
by the slew button 50. These sofhA^are interfaces gen- 
erally employ command bars and pop-down menus to 
allow the user to make selections and input conn- 
mands. 

While the invention has been described in temris 
of a single preferred embodiment, those skilled in the 
art will recognize that the invention can be practiced 
with modification within the spirit and scope of the 
appended claims. 



Claims 

Having thus described our invention, what we 
claim as new and desire to secure by Letters Patent 
is as follows: 

1. In a computer aided training device or simulator 
for training one or rrK>re trainees to perfonn a task, 
the improvement of an onboard instructor station 
comprising: 

an instructor's seat positionable in a dedi- 
cated over-the-shoulder observation position to 
allow an instructor to view a training scenario and 
actk)ns of one or more trainees; 

a display support structure attached to 
said instructor's seat and movable therewith; and 

a display assembly including a flat panel 
display embedded in an integral work surface, 
said display assembly being attached to said sup- 
port structure and providing all displays and 
switch functions required to control and monitor a 
training session directly In front of, and tangent to 
an instructor's seated position without obstructing 
over-the-shoulder observation of the training 
scenario. 
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2. The onboard instructor station as recited In daim 
1 wherein said integral work surface is fonmed by 
a dear plastic overlay of said flat panel display. 

3. The onboard instructor station as recited in daim 5 
1 wherein said flat panel display is a liquid crystal 
display. 

4. The onboard instructor station as recited in daim 

1 wherein said flat panel display is a gas plasma io 
display. 

5. The onboard instmctor station as recited in daim 
1 wherein said display assembly is attached to 
said support structure by means of a hinge allow- is 
ing said display assembly to be rotated 90® to a 
vertical position to allow ingress and egress from 
said instructor's seat. 

6. The onboard instructor station as recited in daim 20 
5 wherein said display assembly is lockable in 

said vertical position and further comprising dam- 
per means for preventing said display assembly 
from rotating to a horizontal position with such 
force as would damage the display assembly. 25 

7. The onboard instructor station as recited in daim 
1 further comprising a bezel surrounding said flat 
panel display and a plurality of push button 
switches embedded In said bezel, said push but- 30 
ton switches being programmable to be display 
dependent. 

8. The onboard instructor station as recited in daim 
1 wherein said display assembly indudes two flat 
panel displays, each of said flat panel displays 
being surrounded with a bezel, further comprising 
a plurality of push button switches embedded in 
the bezel of each of said flat panel displays, said 
push button switches being programmable to be 
display dependent 

9. The onboard instmctor station as recited in daim 
8 wherein each of said flat panel displays are gas 
plasma displays. 45 

10. The onboard instructor station as recited in daim 
8 wherein each of said flat panel displays are 
irquid crystal displays. 

11. The onboard instructor station as recited in daim 

I wherein said flat panel display is a touch screen 
display. 

12. The onboard instructor station as recited in daim 55 

II further comprising a bezel surrounding said 
flat panel display and a plurality of push button 
switches embedded in said bezel, said push but- 



ton switches being programmable to be display 
dependent 

13. The onboard instructor station as recited in daim 
1 further comprising slewing means for allowing 
control of a displayed indicator and selection of 
displayed options and commands. 

14. An instructor station for a computer aided training 
device or simulator for training one or more 
trainees to perfonm a task comprising: 

an instructor's seat positionable in a dedi- 
cated over-the-shoulder observation position to 
allow an instructor to view a training scenario and 
actions of one or more trainees; 

a display support structure attached to 
said instructor's seat and movable therewith; 

a display assembly including a flat panel 
display embedded in an integral wori< surface, 
said display assembly being attached to said sup- 
port structure and providing all displays and 
switch functions required to control and monitor a 
training session directly in front of, and tangent to 
an instructor's seated position without obstructing 
over-the-shoulder observation of the training 
scenario; and 

stewing means mounted in said support 
stmcture for allowing control of a displayed indi- 
cator and selection of displayed options and conrv 
mands. 



tical position and further comprising damper 
means for preventing said display assembly from 
rotating to a horizontal position with such force as 
would damage the display assembly. 



18. The instructor station as recited in daim 16 whe- 
rein said display assembly Indudes two flat panel 
displays, each of said flat panel displays being 
surrounded with a bezel, further comprising a 
plurality of push button switches embedded in the 
bezel of each of said flat panel displays, said push 



15. The instructor station recited in claim 14 wherein 
said display assembly Is attached to said support 
structure by means of a hinge allowing said dis- 

35 play assembly to be rotated 90'' to a vertical posi- 
tion to allow ingress and egress from said 
instructor's seat 

16. The instructor station as recited in claim 15 whe- 
40 rein said display assembly is lockable in said ver- 



1 7. The instructor station as recited in daim 1 6 further 
comprising a bezel surrounding said flat panel 
display and a plurality of push button switches 
embedded in said bezel, said push button 
50 switches being programmable to be display 
dependent 
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button switches being programmable to be dis- 
play dependent. 

19. The instructor station as recited in claim 18 whe- 
rein each of said flat panel displays are gas 5 
plasma displays. 

20. The instructor station as recited in daim 18 whe- 
rein each of said flat panel displays are liquid 
crystal displays. io 

21. The instructor station as recited in claim 18 whe- 
rein said flat panel display is a touch screen dis- 
play. 

15 

22. The instructor station as recited in claim 21 whe- 
rein said flat panel display is a touch screen dis- 
play. 
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